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INTRODUCTION 


Although  the  U.S.  aerospace  industry  continues  to  be  the  leading  positive 
contributor  to  the  balance  of  trade  among  all  merchandise  industries,  it  is  experiencing 
significant  changes  whose  implications  may  not  be  well  understood.1  Increasing  U.S. 
collaboration  with  foreign  producers  will  result  in  a  more  international  manufacturing 
environment,  which  will  allow  for  a  more  rapid  diffusion  of  technology,  increasing 
pressure  on  U.S.  aerospace  companies  to  push  forward  with  new  technological 
developments,  and  to  take  steps  designed  to  maximize  the  inclusion  of  recent 
technological  developments  into  the  research  and  development  (R&D)  process. 

To  remain  a  world  leader  in  aerospace,  the  U.S.  must  take  the  steps  nec^^ry 
to  improve  and  maintain  the  professional  competency  of  aerospace  engineers  and 
scientists,  and  enhance  innovation  and  productivity.  How  well  these  objectives  are  met, 
and  at  what  cost,  depends  on  a  variety  of  factors,  but  largely  on  the  ability  of 
aerospace  engineers  and  scientists  to  acquire  and  process  the  results  of  NASA/DoD 
funded  R&D. 

The  ability  of  U.S.  aerospace  engineers  and  scientists  to  identify,  acquire,  and 
use  scientific  and  technical  information  (STI)  is  of  paramount  importance  to  the 
efficiency  of  the  R&D  process.  Testimony  to  the  central  role  of  STI  in  the  R&D 
process  is  found  in  numerous  studies  (Fischer,  1980).  These  studies  show,  among 
other  things,  that  U.S.  aerospace  engineers  and  scientists  devote  more  time,  on  the 
average,  to  the  communication  of  technical  information  than  to  any  other  scientific  or 
technical  activity  (Pinelli,  et  -l,  1989).  We  concur,  therefore,  with  Fischer’s  (1980) 
conclusion  that  the  "roie  of  scientific  and  technical  communication  is  thns  central  to 
the  success  of  the  innovation  process,  in  general,  and  the  management  of  R&D 
activities,  in  particular." 

The  NASA/DoD  Aerospace  Knowledge  Diffusion  Research  Project  was 
developed  because,  in  terms  of  empirically  derived  data,  very  little  is  known  about 
the  diffusion  of  knowledge  in  the  aerospace  industry  both  in  terms  of  the  channels 
used  to  communicate  the  ideas  and  the  ’"f^raiation-gathering  habits  and  practices  of 
the  members  of  the  social  system  (i.e.,  aerospace  engineers  and  scientists).  Even  less 
is  known  about  the  system  through  which  the  results  of  federally-funded  aerospace 
R&D  is  diffused  throughout  the  aerospace  community.  Understanding  how  STI  is 
communicated  through  certain  channels  over  time  among  members  of  the  social  system 
would  contribute  to  increasing  productivity,  stimulating  innovation,  and  improving  and 
maintaining  the  professional  competence  of  U.S.  aerospace  engineers  and  scientists. 


1  "Aerospace"  includes  aeronautics,  space  science,  space  technology,  and  related 


fields. 


PROJECT  OVERVIEW 


The  NASA/DoD  Aerospace  Knowledge  Diffusion  Research  Project  is  a 
cooperative  effort  that  is  sponsored  by  NASA,  Codes  RF  and  NTT,  and  the  DoD, 
Office  of  die  Assistant  Secretary  of  the  Air  Force,  Deputy  for  Scientific  and  Technical 
Information.  The  research  project  is  a  joint  effort  of  the  Indiana  University  Center  for 
Survey  Research  and  the  NASA  Langley  Research  Center. 

The  project  will  provide  descriptive  and  analytical  data  regarding  the  flow  of 
ST1  at  the  individual,  organizational,  national,  and  international  levels.  It  will  examine 
both  the  channels  used  to  communicate  information  anu  the  social  system  of  the 
aerospace  knowledge  diffusion  process.  The  results  of  the  project  should  provide  useful 
information  to  R&D  managers,  information  managers,  and  others  concerned  "'ith 
improving  access  to  and  use  of  SIX 

Several  major  barriers  to  effective  knowledge  diffusion  exist  in  the  U.S.  First, 
the  very  low  level  of  monetary  support  for  knowledge  transfer  compared  with 
knowledge  production  suggests  that  dissemination  efforts  are  not  viewed  as  an 
important  component  of  the  R&D  process.  Second,  there  are  mounting  reports  from 
users  about  difficulties  in  getting  appropriate  information  useful  for  problem  solving 
and  decision  making.  Third,  rapid  advances  in  many  areas  of  STI  knowledge  can  be 
fully  exploited  only  if  they  are  quickly  translated  into  further  research  and  application. 
Fourth,  current  mechanisms  are  often  inadequate  to  help  the  user  assess  the  quality  of 
available  information.  Fifth,  the  characteristics  of  actual  usage  behavior  are  not 
considered  in  making  available  useful  and  easily  retrieved  information. 

These  deficiencies  must  be  remedied  if  the  results  of  federally  funded  R&D 
are  to  be  successfully  applied  to  innovation,  problem  solving,  and  productivity.  Only 
by  maximizing  the  R&D  process  can  the  U.S.  maintain  its  international  competitive 
edge  in  aerospace. 

Project  Assumptions 

1.  Rapid  diffusion  of  technology  and  technological  developments  requires  an 
understanding  of  the  aerospace  knowledge  diffusion  process. 

2.  Knowledge  production,  transfer,  and  utilization  are  equally  important  components 
of  the  aerospace  knowledge  diffusion  process. 

3.  Understanding  the  channels;  the  information  products  involved  in  the  production, 
transfer,  and  utilization  of  aerospace  information;  and  the  information-seeking 
habits,  practices,  and  preferences  of  aerospace  engineers  and  scientists  is 
necessary  to  understand  aerospace  knowledge  diffusion. 

4.  The  knowledge  derived  from  federally  funded  aerospace  R&D  is  indispensable 
in  maintaining  the  vitality  and  international  competitiveness  of  the  U.S. 
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aerospace  industry  and  essential  in  maintaining  and  improving  the  professional 
competency  of  U.S.  aerospace  engineers  and  scientists. 

5.  The  U.S.  government  technical  report  plays  an  important,  but  as  yet  undefined, 
role  in  the  transfer  and  utilization  of  knowledge  derived  from  federally  funded 
aerospace  R&D. 

6.  Librarians,  as  information  intermediaries,  play  an  important,  but  as  yet 
undefined,  role  in  the  transfer  and  utilization  of  knowledge  derived  from 
federally  funded  aerospace  R&D. 

Project  Objectives 

1.  Understanding  the  aerospace  knowledge  diffusion  process  at  the  individual, 
organizational,  and  national  levels,  placing  particular  emphasis  on  the  diffusion 
of  federally  funded  aerospace  STL 

2.  Understanding  the  international  aerospace  knowledge  diffusion  process  at  the 
individual  and  organizational  levels,  placing  particular  emphasis  on  the  systems 
used  to  diffuse  the  results  of  federally  funded  aerospace  STL 

3.  Understanding  the  roles  NASA/DoD  technical  reports  and  aerospace  librarians 
play  in  the  transfer  and  utilization  of  knowledge  derived  from  federally  funded 
aerospace  R&D. 

4.  Achieving  recognition  and  acceptance  within  NASA,  DoD  and  throughout  the 
aerospace  community  that  STI  is  a  valuable  strategic  resource  for  innovation, 
problem  solving,  and  productivity. 

5.  Providing  results  that  can  be  used  to  optimize  the  effectiveness  and  efficiency 
of  the  Federal  STI  aerospace  transfer  system  and  exchange  mechanism. 

Project  Design 

The  initial  thrust  of  the  aerospace  knowledge  diffusion  research  project  is  largely 
exploratory  and  descriptive;  it  focuses  on  the  information  channels  and  the  members 
of  the  social  system  associated  with  the  Federal  aerospace  knowledge  diffusion  process. 
It  provides  a  pragmatic  basis  for  understanding  how  the  results  of  NASA/DoD  research 
diffuse  into  the  aerospace  R&D  process.  Over  the  long  term,  the  project  will  provide 
an  empirical  basis  for  understanding  the  aerospace  knowledge  diffusion  process  at  the 
individual,  organizational,  national,  and  international  levels.  An  outline  of  the 
descriptive  portion  of  the  project  is  contained  in  Table  1  as  "A  Five  Year  Program  of 
Research  on  Aerospace  Knowledge  Diffusion." 
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Table  1.  A  Five  Year  Program  of  Research  on  Aerospace  Knowledge  Diffusion 
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Phase  1  of  the  4-phase  project  is  concerned  with  the  information-seeking  habits 
and  practices  of  U.S.  aerospace  engineers  and  scientists,  with  particular  emphasis  being 
placed  on  their  use  of  federally  funded  aerospace  STI  products  and  services.  The 
conceptual  model  shown  in  figure  1  assumes  a  consistent  internal  logic  that  governs 
the  information-seeking  and  processing  behavior  of  aerospace  engineers  and  scientists 
despite  any  individual  differences  they  may  exhibit 

The  results  of  the  Phase  1  Riot  Study  indicate  that  U.S.  aerospace  engineers 
and  scientists  spend  approximately  65  percent  of  a  40-hour  work  week  communicating 
STI.  The  types  of  information  and  the  information  products  used  and  produced  in 
performing  professional  duties  tx  similar,  v  th  basic  STI  and  in-house  technical  data 
most  frequently  reported.  Internal  STI  to  thv  c.  ,:-■«?  -uon,  which  includes  NASA/DoD 
technical  reports,  journal  articles,  and  conference/  meeting  papers  is  preferred  over 
external  STI.  Respondents  identified  informal  channels  and  personalized  sources  as 
the  primary  methods  of  seeking  STI,  followed  by  the  use  of  formal  information  sources 
when  solving  technical  problems.  Only  after  completing  an  informal  search,  followed 
by  using  formal  information  sources,  do  they  turn  to  librarians  and  technical 
information  specialists  for  assistance. 


4 


Figure  1.  A  Conceptual  Model  for  the  Use,  Transfer,  and  Production  of  SIT  by 

U.S.  Aerospace  Engineers  and  Scientists 


Phase  2  focuses  on  aerospace  knowledge  transfer  and  use  within  the  larger 
social  system,  placing  particular  emphasis  on  ^  flow  of  aerospace  SH  in  govern¬ 
ment  and  industry  and  the  role  of  the  information  intermediary  (i.e.,  the  aerospace 
librarian/technical  information  specialist)  in  knowledge  transfer.  In  Phase  2,  the  process 
of  innovation  in  the  U.S.  aerospace  industry  is  conceptualized  as  an  infor-  mation 
processing  system  which  must  deal  with  work-related  uncertainty  through  patterns  of 
technical  communications.  Information  processing  in  aerospace  R&D  (figure  2)  is 
viewed  as  an  ongoing  problem  solving  cycle  involving  each  activity  within  the 
innovation  process,  the  larger  organization,  and  the  external  world. 
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Figure  2.  The  Aerospace  R&D  Process  as  an  Information  Processing  System. 
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Phase  3  focuses  on  knowledge  use  and  transfer  at  the  individual  and  organi¬ 
zational  levels  in  the  academic  sector  of  die  aerospace  community.  Faced  with 
shrinking  enrollments,  particularly  at  die  graduate  level,  university  aerospace  programs 
must  find  ways  to  maintain  the  talent  pool  that  will  advance  aerospace  technological 
development  and  guarantee  U.S.  competitiveness. 

Phase  4  examines  knowledge  production,  use,  and  transfer  among  non-U.S. 
individuals  and  aerospace  organizations,  specifically  in  Western  Europe  and  Japan. 
As  U.S.  collaboration  with  foreign  aerospace  technology  producers  increases,  a  more 
international  manufacturing  environment  will  arise,  fostering  an  increased  flow  of  U.S. 
trade.  To  cooperate  in  joint  ventures  as  well  as  to  compete  successfully  at  the 
international  level,  U.S.  aerospace  industries  will  need  to  develop  methods  to  collect, 
translate,  analyze,  and  disseminate  the  best  of  foreign  aerospace  STL 


OVERVIEW  OF  THE  FEDERAL  AEROSPACE 
KNOWLEDGE  DIFFUSION  PROCESS 

A  model  (figure  3)  that  depicts  the  transfer  of  federally  funded  aerospace  R&D 
from  "producer  to  user"  is  composed  of  two  parts  —  the  informal  that  relies  on 
collegial  contacts  and  the  formal  that  relies  on  surrogates,  information  products,  and 
information  intermediaries  to  complete  the  transfer  process. 


Informal  (Collegial) 


Formal 


Figure  3.  A  Model  Depicting  the  Transfer  of  Federally  Funded  Aerospace  R&D. 

Surrogates  serve  as  technical  report  repositories  or  clearinghouses  for  the 
producers  and  include  the  Defense  Technical  Information  Center  (DTIC),  the  NASA 
Scientific  and  Technical  Information  Facility  (NASA  STJF),  and  the  National  Technical 
Information  Service  (NTIS).  These  surrogates  have  created  a  variety  of  technical  report 
announcement  journals  such  as  TRAC  (Technical  Report  Announcement  Circular)  and 
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STAR  (Scientific  and  Technical  Aerospace  Reports)  and  computerized  retrieval  systems 
such  as  DROLS  (Defense  RDT&E  Online  System)  and  RECON  (REmote  CONsole) 
that  permit  online  access  to  technical  report  databases. 

The  producers  are  NASA  and  the  DoD  and  their  contractors  and  grantees. 
Producers  depend  upon  surrogates  and  information  intermediaries  to  complete  the 
knowledge  transfer  process.  When  U.S.  government  technical  reports  are  published* 
the  initial  or  primary  distribution  is  made  to  libraries  and  technical  information  centers. 
Copies  are  sent  to  surrogates  for  secondary  and  subsequent  distribution.  A  limited 
number  are  set  aside  to  be  used  by  the  author  for  the  "sdemist-to-scientist"  exchange 
of  information  at  die  individual  level 


Information  intermediaries  are,  in  large  part,  librarians  and  technical  information 
specialists  in  academia,  government,  and  industry.  Information  intermediaries  represent 
the  producers  and  serve  as  what  McGowan  and  Loveless  (1981)  describe  as  "knowledge 
brokers"  or  "linking  agents."  The  more  "active"  the  intermediary,  the  more  effective 
the  transfer  process  becomes  (Goldhar  and  Lund,  1985).  Active  intermediaries  take 
information  from  one  place  and  move  it  to  another,  often  face-to-face.  Passive 
information  intermediaries,  on  the  other  hand,  "simply  array  information  for  the  taking, 
relying  on  the  initiative  of  the  user  to  request  or  search  out  the  information  that  may 
be  needed"  (Eveland,  1987). 

Two  problems  exist  with  the  formal  part  of  the  system.  First,  the  formal  part 
of  the  system  uses  one-way  producer-to-user  transmission.  The  problem  with  this  land 
of  transmission  is  that  such  formal  one-way  "supply  side"  transfer  procedures  do  not 
seem  to  be  responsive  to  die  user  context  (Bikson,  et  al.,  1984).  Second,  the  formal 
pan  relies  heavily  on  information  intermediaries  to  complete  the  knowledge  transfer 
process.  Empirical  findings  on  the  effectiveness  of  information  intermediaries  and  the 
role(s)  they  play  in  knowledge  transfer  are  sparse  and  inconclusive. 

The  problem  with  the  informal  part  of  the  system  is  that  users  can  leam  from 
collegial  contacts  only  what  those  contacts  happen  to  know.  Ample  evidence  supports 
the  claim  that  no  one  researcher  can  know  about  or  keep  up  with  all  of  the  research 
in  his/her  area(s)  of  interest  Like  other  members  of  the  scientific  community, 
aerospace  engineers  and  scientists  arc  faced  with  the  problem  of  too  much  information 
to  know  about,  to  keep  up  with,  and  to  screen  -  information  that  is  becoming  more 
interdisciplinary  in  nature  and  more  international  in  scope. 
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THE  DoD  PERSPECTIVE 


The  U.S.  aerospace  industry  exhibits  certain  characteristics  which  make  it  unique 
among  other  industries.  First,  the  U.S.  aerospace  sector  leads  all  other  industries  in 
expenditures  for  R&D  (U.S.  Department  of  Commerce,  1990).  Second,  the  U.S. 
aerospace  industry  has  benefited  as  a  technological  "borrower”  from  developments  in 
other  industries  such  ai  metallurgy,  materials,  chunicals,  and  petroleum  (Mowery  and 
Rosenberg,  1982).  Third,  the  aerospace  industry,  in  particular  the  commercial  aviation 
sector,  is  characterized  by  the  high  degree  of  systemic  complexity  embodied  in  its 
{noducts.  Finally,  the  U.S.  aerospace  industry,  principally  die  commercial  aviation 
sector,  has  been  the  beneficiary  of  federally  fiinded  R&D  for  nearly  a  century.  The 
commercial  aviation  sector  L*s  also  benefited  from  considerable  investment,  in  terms 
of  research  and  procurement,  by  die  Department  of  Defense  (DoD).  "Although  not 
intended  to  support  innovation  in  any  but  military  airframe  and  propulsion  technologies, 
[this  investment]  lias,  nonetheless,  yielded  indirect,  but  very  important,  technological 
spillovers  to  the  commercial  aircraft  industry"  (Mowery,  1985). 

The  DoD  plays  an  enormously  significandy  role  in  the  "supply-push"  side  of 
the  aerospace  knowledge  diffusion  process.  Research  supported  by  the  DoD  has 
yielded  indirect,  but  very  important,  innovative  spillovers  to  the  commercial  aircraft 
sector  of  the  U.S.  aerospace  industry,  most  notably  in  the  areas  of  airframe 
development,  aircraft  propulsion,  avionics,  and  flign;  control  systems.  The  demands 
of  the  military  for  performance  pushed  the  development  and  early  application  of  many 
technologies.  The  military  supported  jet  engine  development,  provided  continued 
support  for  the  development  of  specific  military  engines  whose  cores  were  adapted  for 
commercial  use,  and  provided  the  test-beds  for  the  technological  development  of  early 
commercial  jet  aircraft  (March,  1989).  The  development  of  the  first  jet  engine  in  the 
United  States  was  financed  entirely  by  the  DoD,  reflecting  "both  the  perceived  military 
urgency  of  the  project,  and  the  lack  of  interest  in  the  development  of  such  an  engine 
expressed  by  commercial  aircraft  firms  prior  to  1940"  (Mowery  and  Rosenberg,  1982). 

Data  and  Research  Methods 

The  data  for  this  paper  were  collected  as  parts  of  Phases  1,  2  and  3  of  the 
NASA/DoD  Aerospace  Knowledge  Diffusion  Project.  The  results  of  surveys  con¬ 
ducted  in  each  Phase  are  reported  separately.  These  results  comprise  only  a  selected 
portion  of  the  DoD  data  collected  in  the  Project 


Phase  1.  The  sample  for  Phase  1  of  the  NASA/DoD  Aerospace  Knowledge 
Diffusion  Project  was  drawn  from  the  membership  of  the  American  Institute  of 
Astronautics  and  Aeronautics  (AIAA)  as  of  January,  1988.  The  AIAA  is  a  professional 
research  society  comprised  of  aerospace  engineers  and  scientists.  A  twenty  percent 
sample  of  AIAA  members  were  selected  for  the  Phase  1  surveys. 

Three  surveys  of  AIAA  members  were  conducted  as  part  of  Phase  1.  The 
sample  for  the  first  survey  was  3298  ALA  A  members.  2016  members  returned  able 
questionnaires.  The  second  survey  had  a  sample  of  1735  members  and  975  usable 
questionnaires  were  returned.  For  the  third  survey,  the  numbers  were  1705  and  955 
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respectively.  In  earlier  research,  (Kennedy  and  Pinelli,  1990)  we  reported  an  analysis 
of  the  response  rates  and  patterns.  The  anjusted  response  rate  for  these  surveys  was 
between  65  and  70  percent  Tire  surveys  were  conducted  from  May  1989  through 
February  1990. 

The  first  questionnaire  focused  on  the  following  topics:  the  use  and  evaluation 
of  conference  and  meeting  papers,  journal  articles,  government  technical  reports,  and 
in-house  technical  reports.  It  also  contained  questions  related  to  the  use  of  information 
technology,  the  steps  used  in  conducting  information  searches  and  demographic 
information.  This  survey  is  not  reported  here. 

The  second  questionnaire  focused  on  the  use  and  evaluation  of  NASA  technical 
reports,  DoD  technical  reports,  AGARD  technical  reports,  foreign  technical  reports, 
journal  articles  and  conference  and  meeting  papers.  The  questionnaire  also  asked 
about  the  current  sources  of  research  funding  and  demographic  information.  Figures 
4  through  9  are  based  on  these  data.  Eighty-four  percent  of  these  respondents  received 
some  federal  funding.  Most  are  well-educated:  25  percent  have  a  BS;  39  percent  a 
MS;  and  27  percent  a  PhD.  Eighty-four  percent  were  trained  as  engineers  and  eleven 
percent  as  scientists,  but  67  percent  classify  their  current  dudes  as  engineers. 

Figure  4  shows  the  proportion  of  .espondcnts  who  used  a  NASA,  DoD  or 
AGARD  technical  report  in  the  six  months  prior  to  completing  the  questionnaire. 


Used  one  or  more  times  in  past  6  months 


Figure  4.  Use  of  Technical  Repeats  by  U.S.  Aerospace  Engineers  and  Scientists. 
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Approximately  SO  percent  of  the  sample  reported  using  at  least  one  NASA  technical 
report  in  the  period.  Forty-three  percent  reported  using  a  DoB  technical  report  and 
about  19  percent  said  they  used  at  least  one  AGARD  technical  report 

The  respondents  woe  asked  to  evaluate  tbs  importance  of  information  sources 
in  performing  their  current  professional  duties.  They  were  asked  to  use  a  five  point 
scale  where  the  end  scores  were  "very  important"  and  "not  at  all  important".  Figure 
5  shows  the  proportion  who  answered  with  either  a  "1"  cr  a  “2"  on  the  scale. 

60 


50 


40 


Percent  30 


20 


10 


NASA  DOD  AGARD 
One  or  two  on  a  five  point  scale 

Figure  5.  Importance  of  Technical  Reports  to 
U.S.  Aerospace  Engineers  and  Scientists. 

Forty-one  percent  reported  that  DoD  technical  reports  were  important  in  performing 
their  current  duties.  The  percentages  of  the  sample  reporting  similar  importance  for 
NASA  and  AGARD  technical  reports  were  51  and  17  percent  respectively.  The  data 
from  Figures  4  and  5  indicate  that  the  NASA  and  DoD  technical  reports  were  used 
regularly  by  U.S.  aerospace  researchers  and  that  these  technical  reports  were  important 
to  their  research. 


Those  who  reported  they  did  not  use  each  of  the  technical  reports  were  asked 
the  reasons  why  they  were  not  used.  Figure  6  contains  the  proportion  w'ho  responded 
"yes"  to  each  reason  when  asked  specifically  about  DoD  reports.  The  reasons  reported 
in  figure  6  were:  Rot  available  (27  percent);  not  used  in  my  discipline  (18  percent); 
and,  not  timely  (7  percent).  However,  the  reason  offered  most  often  for  not  using  DoD 
technical  report?  was  that  they  were  not  relevant  to  the  research  being  conducted  (40 
percent).  Only  2  percent  of  the  researchers  cited  problems  with  the  reliability  or 
accuracy  as  reasons  for  not  using  DoD  technical  repons. 


10 


45 
40 
35 
30 
25 

Percent 

20 
15 
10 
5 
0 

Not  relevant  Not  available  Not  used  in  Not  timely 
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One  or  two  on  a  five  point  scale 

Figure  6.  Reasons  Why  DoD  Technical  Reports 
Arc  Not  Used  by  U.S.  Aerospace  Engineers  and  Scientists 

Figures  7  through  9  contain  questions  asked  of  those  who  used  DoD  technical 
reports  in  the  six  months  prior  to  the  survey.  Most  the  respondents  (figure  7)  reported 

80 
70 
60 
50 

Percent  40 
30 
20 
10 
G 

Request  from  Colleague  SentbyNTIS  Sent  by  DOD 
library 

Figure  7.  How  U.S.  Aerospace  Engineers  and  Scientists 
Obtain  DoD  Technical  Reports 


11 


obtaining  DoD  technical  reports  from  a  library  C/1  percent)  and/or  from  a  colleague 
(57  percent).  Substantial  portions  repotted  obtaining  DoD  technical  reports  from  NTIS 
(39  percent)  and  from  DoD  (37  percent).  These  data  indicate  that  while  the  largest 
percentage  came  from  libraries,  many  researchers  used  other  msans  of  obtaining  DoD 
technical  reports. 

Users  were  asked  to  rate  DoD  technical  reports  vfigure  8).  A  four  point  scale 
from  excellent  to  poor  was  given  for  each  rating  characteristic.  Readers  should 

90 
80 
70 
60 
50 

Percent 

40 
30 
20 
10 


Quality  Accuracy  Organization  Timeliness  State-of-the-art 
One  or  two  on  a  five  point  scale 

Figure  8.  How  U.S.  Aerospace  Engineers  and  Scientists 
Rate  DoD  Technical  Reports 

interpret  these  data  as  relative  rather  than  absolute  numbers.  That  is,  the  interpretation 
should  be  across  characteristics,  e.g.,  quality  and  accuracy  were  more  important  than 
organization.  Over  three-fourths  of  the  users  gave  the  two  highest  responses  when 
asked  about  the  quality  (80  percent)  and  accuracy  (78  percent)  of  DoD  technical 
reports.  High  ratings  were  also  given  to  the  organization  (59  percent)  and  timeliness 
(56  percent)  of  the  reports. 

Most  users  felt  that  relevance  (72  percent)  and  accessibility  (72  percent) 
influenced  their  decision  to  use  DoD  technical  reports  (figure  9).  Familiarity  (62 
percent),  technical  quality  (56  percent)  and  ease  of  use  (54  percent)  also  influenced 
more  than  one-half  of  the  users.  Together,  the  data  in  figures  7  through  9  indicate 
that  users  of  DoD  technical  reports  rated  them  highly  in  quality  and  accuracy,  used 
them  because  they  are  relevant  and  accessible,  and  received  them  primarily  from  a 
library. 
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Figure  9.  How  U.S.  Aerospace  Engineers  and  Scientists 
Rate  DoD  Technical  Reports 


The  third  questionnaire  sent  as  part  of  Phase  1  focused  on  the  knowledge  and 
the  use  of  Federal  announcement,  current  awareness,  and  bibliographic  tools  (figure  10). 


Source 

Percent  not  use 

Percent 

familiar 

Percent 
not  familiar 

STAR 

23.8 

19.7 

56.6 

NASA 

SP-7037 

6.7 

9.2 

84.1 

CAB 

2.0 

94.3 

GRA&I 

3.8 

92.9 

RECON 

12.2 

82.3 

DROLS 

3.7 

1.8 

94.5 

NTIS 

_ 

18.0 

11.4 

70.6 

Figure  10.  Use  and  Nonuse  of  Federal  Information  Sources  by 
U.S.  Aerospace  Engineers  and  Scientists 
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Many  of  these  sources  are  designed  primarily  for  use  by  intermediaries  rather  than 
researchers  end  users).  The  data  in  figure  10  indicate  that  only  a  small  proportion  of 
the  sample  used  these  sources.  STAR  had  been  used  by  24  percent  of  the  sample  and 
fewer  than  50  percent  woe  aware  that  it  exists.  Two  percent  of  the  sample  used  CAB 
and  94  percent  were  not  aware  of  its  existence.  Use  of  on  line  systems  was  low  and 
ranged  from  a  high  of  18  percent  for  NTIS  to  a  low  of  about  4  percent  for  DROLS. 
Overall,  use  of  these  products  was  low;  most  respondents  were  simply  not  aware  of 
many  of  these  sources. 

Phase  3.  In  Phase  3  of  the  NASA/DoD  Aerospace  Knowledge  Diffusion  Project 
surveys  were  conducted  among  aerospace  students,  faculty,  and  librarians  in  aerospace 
or  engineering  libraries.  The  student  survey  consisted  of  students  who  were  enrolled 
in  a  capstone  design  course  that  was  funded  by  NASA  through  the  University  Space 
Research  Association.  Forty-four  design  courses  were  funded  in  the  1989-1990  school 
year.  Of  this  group  33  schools  participated  in  the  survey.  Some  schools  could  not 
participate  because  their  capstone  design  course  was  taught  in  the  fall  and  the  student 
survey  was  conducted  during  April  and  May  1990.  Twenty-one  of  the  courses  were 
taught  in  aerospace  departments,  twelve  in  other  departments,  primarily  mechanical 
engineering  and  architecture.  Useable  questionnaires  were  returned  by  591  students. 

The  faculty  who  participated  in  the  survey  were  members  of  aerospace 
depanmen*"  where  the  USRA  design  courses  were  taught.  Those  faculty  who  were 
sent  .questionnaires  in  Phase  1  were  excluded  from  the  sample.  Questionnaires  were 
sent  to  501  faculty  and  275  returned  them  by  early  summer.  The  faculty  and  student 
questionnaires  wvre  almost  identical.  They  focused  on  the  knowledge  and  use  of 
techrrial  reports,  training  in  technical  communications,  the  use  of  bibliographic 
databases  and  demogra^nic  characteristics. 

In  the  Phase  3  questionnaires,  the  respondents  were  not  asked  how  many  times 
they  used  an  information  source  as  was  asked  in  Phase  1.  Rather  they  were  asked  how 
often,  on  a  five  point  scale,  they  had  used  information  sources  during  the  current 
school  year.  Figure  1 1  shows  die  distribution  of  use  for  five  information  sources.  As 
might  be  expected,  the  faculty  used  journal  articles  (80  percent)  most  often  followed 
by  NASA  technical  reports  (39  pereent).  Faculty  made  less  use  of  DoD,  AGARD,  and 
foreign  technical  reports.  Students.  he.vever,  used  journal  articles  and  NASA  technical 
reports  about  equally  (52  percent  and  51  percent,  respectively)  and  made  greater  use 
of  NASA  technical  reports  than  did  faculty  members.  It  might  be  expected  that  the 
students  in  these  design  courses  would  make  relatively  heavy  use  of  NASA  technical 
reports.  DoD,  AGARD,  and  Foreign  technical  reports  were  used  relatively  less  often. 

The  faculty  and  students  rated  the  importance  of  information  sources  in  the 
same  ranking  as  their  use  (figure  1?\  Most  faculty  (87  percent)  rated  journal  articles 
as  one  or  two  on  a  five  point  scale.  The  students  rated  journal  articles  [t  i  percent) 
and  NASA  technical  report:  (55  percent)  as  about  equally  important.  Both  faculty  (26 
percent)  and  students  (16  percent)  rated  DoD  technical  reports  as  relatively  more 
important  than  would  be  expected  from  their  use. 


14 


Percent 


Percent 


Faculty 

Students 


Journal  articles  NASA  TRs  DODTRs  AGARDTRs  Foreign  TRs 
One  or  two  on  a  five  point  scale 

Figure  11.  Use  of  Selected  Information  Products  by 
U.S.  Aerospace  Faculty  and  Students 


Journal  articles  NASA  TRs  DODTRs  AGARDTRs  Foreign  TRs 
One  or  two  on  a  five  point  scale 

Figure  12.  Importance  of  Selected  Information  Products  to 
U.S.  Aerospace  Faculty  and  Students 
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As  shown  in  figure  13,  some  faculty,  but  few  students  are  aware  of  RECON 
(40  and  14  percent,  respectively),  DROLS  (29  and  6  percent,  respectively)  and  NTIS 
Online  (47  and  14  percent,  respectively).  Both  faculty  and  students  were  most  familiar 
with  NTIS  Online  and  least  familiar  with  DROLS. 


Figure  13.  Familiarity  with  Federal  On  Line  Databases 
by  U.S.  Aerospace  Faculty  and  Students 

Library  Surveys.  Two  library  surveys  were  conducted.  The  first  survey, 
conducted  as  part  of  Phase  2,  included  156  technical  libraries  located  within 
government  and  industrial  organizations  that  held  aerospace  collections  including  U.S. 
government  technical  reports.  The  second  survey,  conducted  as  part  of  Phase  3, 
included  68  academic  libraries  associated  with  aerospace  engineering  programs. 

Of  the  first  group,  most  libraries  or  technical  information  centers  (TIC)  were 
cost  centers  in  which  the  library /TIC  costs  were  charged  to  the  overhead  of  the 
organization  (Figure  14).  Twelve  percent  of  the  libraries  surveyed  were  cost-justified 
centers  in  which  the  library  operates  on  its  own  budget  TTie  remaining  libraries 
functioned  as  self-sufficient  or  profit  centers. 

Both  government,  industry,  and  academic  libraries  regularly  received  both  NASA 
(82  and  71  percent)  and  DoD  (76  and  36  percent)  technical  reports  in  paper  form 
(figure  15).  A  smaller  number  of  academic  libraries  received  DoD  (36  percent)  than 
AGARD  (63  percent)  paper  technical  reports. 
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Figure  14.  How  U.S.  Aerospace  libraries  in  Government 
and  Industry  and  Organizaed 


Percent 


Figure  15.  Receipt  of  NASA  and  DoD  Technical  Reports  in  Paper  by 
U.S.  Government,  Industry,  and  Academic  Libraries 
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Academic  libraries  regularly  received  more  NASA  technical  reports  in  fiche  (91 
percent)  form  than  in  paper  (71  percent)  form  (figure  16).  DoD  and  AGARD  technical 
report*  in  fiche  form  were  received  less  regularly  by  both  industry/government  and 
academic  libraries  than  paper  reports. 


Fiche  reports 

Figure  16.  Receipt  of  NASA  and  DoD  Technical  Reports  in  Fiche  by 
U.S.  Government,  Industry,  and  Academic  Libraries 

Government  and  industry  technical  libraries  received  more  foreign  technical 
reports  than  did  academic  libraries  (figure  17).  British  (32  percent),  ESA  (32  percent) 


British  ESA  French  German  Japanese  Swedish 
Figure  17.  Receipt  of  Foreign  Technical  Reports  by 
U.S.  Government,  Industry,  and  Academic  Libraries 
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and  German  (20  percent)  technical  reports  were  received  more  frequently  than  French 
(12  percent),  Japanese  (6  percent)  and  Swedish  (6  percent)  reports.  Academic  libraries 
received  more  Japanese  and  Swedish  reports  than  did  government  and  industry  libraries. 

Tue  data  in  figure  18  report  the  use  of  on  line  databases  in  U.S.  government 
and  industry  aerospace  libraries.  RECON  and  DROLS  were  not  used  or  were  not 


Percent 


Light  Heavy  Not  used/not  have 

Amount  of  use 


Figure  18.  Use  of  DROLS,  RECON,  and  NTIS  by 
U.S.  Government  and  Industry  Aerospace  Libraries 

available  to  60  percent  of  the  libraries.  NTIS  Online  had  the  heaviest  use  and 
availability.  Of  the  libraries  that  use  these  on  line  databases,  DROLS  was  used  more 
than  RECON.  DROLS  and  RECON  had  the  highest  "not  used/not  have"  scores. 

Among  users  of  online  databases  DROLS  and  NTIS  Online  were  of  about  equal 
importance  (figure  19).  RECON  was  found  to  be  less  important  than  NTIS  and 
DROLS  but  still  rated  as  important  to  many  U.S.  government  and  industry  libraries. 
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One  or  two  on  a  five  point  scale 


Figure  19.  Importance  of  DROLS,  RECON,  and  NTIS  to 
U.S.  Government  and  Industry  Aerospace  Libraries 


CONCLUDING  REMARKS 

To  remain  world  leaders  in  industry,  aerospace  producers  must  take  the  steps 
necessary  to  improve  and  maintain  the  professional  competency  of  aerospace  engineers 
and  scientists  and  to  enhance  innovation  and  productivity  as  well  as  maximize  the 
inclusion  of  recent  technological  developments  into  the  R&D  process.  How  well  these 
objectives  are  met  in  the  U.S.,  and  at  what  cost,  depends  on  the  ability  of  aerospace 
engineers  and  scientists  to  acquire  and  process  the  results  of  government  funded  R&D. 
However,  very  little  is  known  about  the  channels  used  to  communicate  this  knowledge 
and  the  information-seeking  habits  and  practices  of  the  members  of  the  aerospace  social 
system  (i.e.  aerospace  engineers  and  scientists).  The  NASA/DoD  Aerospace  Knowledge 
Diffusion  Research  Project  seeks  to  remedy  this  situation  by  exploring  the  interface 
between  the  user,  the  information  products  and  services  used  (e.g.,  NASA  and  DoD 
technical  reports),  and  the  criteria  and  factors  associated  with  the  selection  or  use  of 
a  particular  information  product  or  service. 

Overall,  the  data  collected  thus  fa.  indicate  that  DoD  technical  reports  arc  an 
important  information  source  to  the  U.S.  aerospace  research  community.  Researchers 
and  intermediaries  in  government  and  industry  settings  tend  to  use  them  more  regularly 
than  faculty,  students,  and  intermediaries  in  academic  settings.  The  differences, 
however,  may  be  due  to  the  samples  selected  for  Phase  3  of  the  NASA/DoD  Aerospace 
Knowledge  Diffusion  Project.  Further  analysis  is  needed,  however,  before  definitive 
conclusions  and  interpretations  can  be  reached. 
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